PATENT 

Attorney Docket No. McD121 
Client No. 83629.0040 
Express Mail No . EL841974825US 

MULT I - RATE SHARED MEMORY ARCHITECTURE FOR 
FRAME STORAGE AND SWITCHING 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates, in general, 
to the field of fibre channel switching technology. 
More particularly, the present invention relates to a 
5 route caching scheme for a receive port in a fibre 
channel switch. 

[0002] Fibre Channel is a high performance, serial 
interconnect standard designed for bi-directional, 
point-to-point communications between servers, storage 
10 systems, workstations, switches, and hubs. It offers a 
variety of benefits over other link-level protocols, 
including efficiency and high performance, 
scalability, simplicity, ease of use and installation, 
and support for popular high level protocols. 

15 [0003] Fibre channel employs a topology known as a 
"fabric" to establish connections between ports. A 
fabric is a network of switches for interconnecting a 
plurality of devices without restriction as to the 
manner in which the switch can be arranged. A fabric 

20 can include a mixture of point-to-point and arbitrated 
loop topologies. 

[0004] In Fibre Channel, a channel is established 
between two nodes where the channel's primary task is 
to transport data from one point to another at high 
25 speed with low latency. The Fibre channel switch 

provides flexible circuit /packet switched topology by 
establishing multiple simultaneous point-to-point 
connections. Because these connections are managed by 
the switches or "fabric elements" rather than the 
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connected end devices or "nodes", fabric traffic 
management is greatly simplified from the perspective 
of the device. 

[0005] In a fibre channel switching environment, a 
5 shared memory within the switching element is used to 
store incoming frames bound for a particular exit 
port. A destination ID (D_ID) value in the frame 
header identifies the exit port associated with the 
incoming frame. For multiple data rates, rate 
10 matching FIFO's are used to store the frames before 
transmission out the receiving port. 

[0006] In prior approaches, shared memory and 
storage structures required a large rate matching FIFO 
to support multiple data rates. For example, to 

15 buffer a frame that is incoming at twice the rate of 

the outgoing port, the FIFOs are at least one half the 
size of the maximum length frame. Since such FIFO's 
must necessarily be large to accommodate the number of 
ports that are coupled to shared memory, this approach 

20 requires a significant sized FIFO. 

[0007] Existing architectures for buffer are also 
inefficient. For example, memory locations may be 
allocated to a particular frame, but never actually 
used. Buffers must handle both rate adaptive cases 
25 and same-speed cases, and if they use the same 

read/write method for both cases, memory is wasted. 
The current invention provides a different read/write 
methodology depending on the case. 

SUMMARY OF THE INVENTION 

30 [0008] A shared memory design in accordance with 
the present invention provides a solution to the 
aforementioned problem by providing a shared location 
for storing data frames prior to transmission to a 
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receiving port in an efficient manner. The present 
invention can be implemented without requiring 
significant design changes and with only a relatively 
straightforward alteration to existing processes for 
5 networking in a fibre channel switching environment. 

[0009] Particularly disclosed herein is a method 
for routing a data frame through a fibre channel 
fabric having a switch with a plurality of ports. The 
ports are operative for transmitting and receiving the 

10 data frame. A first port of the switch receives the 
data frame. The data frame is then written to a 
shared memory location. The shared memory location is 
coupled to at least two of the plurality of ports. A 
second port of the switch is identified. The second 

15 port is operative for transmitting the data frame from 
the shared memory location. A message is transmitted 
from the first port to the second port indicating the 
position in the shared memory location of the data 
frame. Finally, the data frame is read from the 

20 shared memory to the second port, wherein the switch 
has more than one rate for reading and writing data. 

[0010] In another aspect, the present invention 
provides a shared memory location within a fibre 
channel fabric having a plurality of ports. The 

25 shared memory is coupled to the plurality of ports. 

The shared memory has a plurality of memory locations, 
each memory location having a column and also having a 
plurality of rows for storing a data frame. The 
shared memory also has a plurality of first-in, first 

30 out data storage locations, wherein a word is written 
from the memory location to the first-in first-out 
storage location before transmission to a port. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0011] The aforementioned and other features and 
objects of the present invention and the manner of 
attaining them will become more apparent and the 
5 invention itself will be best understood by reference 
to the following description of a preferred embodiment 
taken in conjunction with the accompanying drawings, 
wherein : 

[0012] Fig. 1 is a block diagram of a switching 
10 element, wherein the switching element has a shared 

memory, a central route table and a plurality of fibre 
channel ports; 

[0013] Fig. 2 is a detailed block diagram 
illustrating one embodiment of an interrelationship 
15 between modules of the switching element, particularly 
the fibre channel ports, local control route module, 
shared memory, and QC module ; 

[0014] Fig. 2A is a block diagram illustrating a 
typical interface between a fibre channel port and a 
20 local route control module, - 

[0015] Fig. 3 is a detailed block diagram of a 
local route control module; 

[0016] Fig. 4 is a flow chart for a data cache 
operation; 

25 [0017] Fig. 5A is a block diagram of several 
columns of memory; 

[0018] Figure 5B illustrates several columns of 
memory and a read and a write operation for each 
column ; 
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[0019] Figure 6 illustrates a 2 gigibit per second 
write and a 2 gigibit per second read after a 2 
gigibit per second write; 

[0020] Figure 7 illustrates a 2 gigibit per second 
5 write and a 1 gigibit per second read after a 2 
gigibit per second write; 

[0021] Figure 8 illustrates a 1 gigibit per second 
write and a 2 gigibit per second read after a 1 
gigibit per second write; 

10 [0022] Figure 9 illustrates a 1 gigibit per second 
write and a 2 gigibit per second read after a 1 
gigibit per second write; and 

[0023] Fig. 10 is a block diagram of the request 
exit port bus and the exit port response bus. 

15 DESCRIPTION OF A PREFERRED EMBODIMENT 

[0024] The present invention is illustrated and 
described in terms of a fibre channel fabric and 
particular fibre channel fabric elements (e.g., 
switches) , however, the present invention is readily 

20 adapted to other protocols and environments. 

Particular examples herein specify data transmission 
rates and specific values and types of components to 
ease illustration and understanding. However, these 
specific examples are not limitations of the present 

25 invention unless explicitly indicted to the contrary. 

[0025] Figure 1 shows a generalized block diagram 
of a fibre channel switch for use in a fibre channel 
fabric implementing the method and systems of the 
present invention. In one embodiment, the fibre 
30 channel switching element 100 of Figure 1 may be 
implemented on a single application specific 
integrated circuit (ASIC) . However, there are many 
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implementations of switch 100 not shown, such as frame 
buffer memory could be located in each GL_Port in 
which case shared memory is replicated with a crossbar 
switch . 

5 [0026] The fibre channel fabric associated with 
switch 100 is the method for connecting the various 
node ports (N-Ports) of the devices together. In this 
way, the fabric is capable of routing fibre channel 
frames using only the destination identification 
10 information in the fibre channel frame header. The 
destination identification information identifies 
which N-Port receives the frame. 

[0027] Fibre channel switch 100 has a plurality of 
ports for receiving and transferring data through the 

15 switch. In Figure 1, the ports are illustrated as GL- 
ports 130, 135 and 140. In one embodiment, switch 100 
comprises 24 GL_Port modules. Each GL_Port is coupled 
to shared memory 120 and external optical interface 
160. External optical interface couples switch 100 to 

20 the N-Port of the device coupled to the fibre channel 
fabric. Fibre channel switch 100 is associated with a 
central route table 110. Central route table 110 is 
operatively coupled to each GL-Port associated with 
fibre channel switch 100 (not shown in Figure 1) . 

25 Switch 100 also has a system interface 150. System 

interface module 150 provides interfaces to the power 
supply, fans, temperature sensor, LED's, and the 
serial interfaces of the optical transceivers. 

[0028] Continuing, fibre channel switch 100 has an 
30 embedded port 145 in addition to illustrated GL_Ports 
130, 135 and 140. Within the context of the 
invention, embedded port 145 may be used for several 
functions. First, it may provide a system services 
processor an access point for all of the fibre channel 
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well-known addresses for both the reception and 
transmission of frames. Secondly, it may handle any 
fibre channel frame that cannot be delivered to a 
destination for either busy, reject, or timeout 
5 conditions. It may also be responsible for the 

generation, modification and/or interpretation of all 
Fibre Channel -Arbitrated Loop (FC-AL) initialization 
frames (such as LI FA, LI PA, LIHA, and LISA frames) for 
the GL-Ports operating in fabric loop mode. The 

10 embedded port interface is slightly different than 
that of an actual GL_Port module. Since the Fibre 
Channel-0/1 layers are not required, embedded port 145 
does not implement the low-level interface for either 
primitive signaling or sequences. After the system 

15 services processor has completed initialization of 

embedded port 145, it enters and remains in the fibre 
channel active state. 

[0029] Embedded port 145 provides a register set 
accessible to the system services processor for basic 

20 initialization and low-level control. Once enabled, 
embedded port 145 is responsible for all functions 
related to the transmission and reception of frames to 
and from shared memory 120. For data path consistency 
within the following description, the direction of 

25 fibre channel frame flow is referenced to shared 
memory 120. Thus, a transmit (TX) path actually 
contains paths destined to, or received by, the 
embedded port from shared memory 12 0 and a receive 
(RX) path contains frames generated or transmitted by 

3 0 embedded port 14 5. 

[0030] Embedded port 145 creates and consumes 
buffers that contain complete fibre channel frames. 
Frames may be held in SRAM coupled to embedded port 
145. SRAM will typically hold two frames, one TX 
35 frame received from shared memory 12 0 and one RX frame 



waiting to be moved into shared memory 120. All other 
TX frames waiting to be read by embedded port 145 and 
RX frames previously created by embedded port 145 are 
stored in shared memory buffers. In one embodiment, 
embedded port 145 may be allocated up to 12 shared 
memory buffers for storage of RX frames. Typically, TX 
frames utilize the shared memory buffers allocated to 
the GL-Ports that receive the fibre channel frames. 

[0031] For example, for fast turn-around of 
Arbitrated Loop address initialization frames, a TX 
frame may be modified in place in the embedded port 
SRAM by software and sent via an RX path without the 
need to move the frame. One of the shared memory 
buffers allocated to an embedded port may be 
designated as a protected buffer. The protected buffer 
can be filled with an RX frame that is transmitted 
frequently and left intact so that the frame can be 
sent to an exit port without the time delay of moving 
the frame from the extended port SRAM to the shared 
memory buffer. 

[0032] An embedded port receiver (RX) is used to 
transfer frames from a system services processor to 
other ports in the switch 100. The Receiver module 
will be substantially similar to the GL_Port RX module 
described hereinafter. Similarly, an embedded port 
transmitter (TX) is used to transfer frames from other 
ports via shared memory to a system services 
processor. The Transmitter module will be 
substantially similar to the GL_Port TX module also 
described hereinafter. An Embedded Port Front-end is 
used to transfer data between the Embedded Port SRAM 
and the TX and RX modules. 

[0033] Shared memory 120 provides buffering and 
switching for all fibre channel frames that flow 



through switch 100. Received frames are written to 
shared memory 12 0 by the receiving port then read from 
shared memory 120 by the transmitting port. In one 
embodiment, shared memory 12 0 has 162 total frame 
locations shared by the GL-Ports 130, 135 and 140 and 
embedded port 14 5. In such an example, each port may 
be allocated as many as 12 buffers, so long as the 
total of 162 buffers is not exceeded. 

[0034] Central Route Control module 110 provides a 
common route table for all ports in switch 100. Route 
table provides a translation from each possible 
Destination ID (D_ID) value to the appropriate exit 
port. Additionally, the route table provides for hard 
zoning, which is the capability for blocking traffic 
from certain receive ports to certain D_IDs . Each port 
uses an exit port request and response bus to 
communicate with central route table 110. 

[0035] GL_Ports 130, 135 and 140 transmit and 
receive fibre channel frames to and from the switch 
and to and from the fibre channel fabric. As shown in 
Figure 1, each GL_Port is coupled to an external 
optical interface 160 that in turn couples the port to 
the fabric and ultimately to the N_Port of the 
destination device. 

[0036] GL_Ports may function as an E_Port , an 
F_Port or an FL_Port , for example. An E_Port is an 
expansion port that serves as a physical interface 
within the fabric that is used to create multi-switch 
fabrics by attaching another switches E_Port through 
an interswitch link (ISL) . An F_Port is a fabric port 
that operates as a physical interface within the 
fabric that attaches to an N_Port of a destination 
device through a point-to-point link connection. An 
FL_Port is a fabric loop port that contains arbitrated 



loop (AL) functions associated with the FC-AL 
topology. FC-AL is a fibre channel topology where 
ports use arbitration to establish a point-to-point 
circuit . 

[0037] Figure 2 illustrates one possible method of 
connecting GL_Ports 130 and 135, as well as possible 
connections between the ports and shared memory 12 0 
and local control route module 200. GL_Port 130 has a 
TX module 23 0 and an RX module 22 0 for sending and 
receiving frames. GL_Port 135 also has a TX module 
235 and RX module 225. For example, if GL_Port 130 is 
the receiving port for a data frame and GL_Port 135 is 
the exit port for the data frame, the frame would 
first be sent from RX module 220 to shared memory 120 
and then sent from shared memory 12 0 to TX module 23 5 
as illustrated. 

[0038] Continuing with the illustrated example of 
Figure 2, RX port module of GL_Port 130 is coupled to 
TX port module of GL_Port 135 through a QC module 205. 
QC Control Module 205 acts as the control interface 
between the TX module 235 and RX module 220. QC 
Control Module 205 routes both a request and an 
acknowledgement signals between GL_Ports that serve to 
transmit exit port information and location of the 
fibre channel frame in shared memory from RX module 
220 as well as return a successful frame transmission 
message from TX module 235. 

[0039] Local route control module (LR) 200 is used 
by the GL_Port RX module to request the exit port for 
a frame based on the frame's destination ID value 
(D_ID) . As shown in Figure 2, a send and receive 
connection couples RX module 220 of GL_Port 130 with 
LR 200. The connection allows RX module 220 to 
request an exit port from the local control route 
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module 200 and also for LR 200 to transmit the 
identity of the exit port back to RX module 220. 

[0040] Figure 2A illustrates the communication 
between GL_Port 130 and local route control module 200 
5 in greater detail. TX control module 230 and RX 

control module 220 are coupled through fibre channel 
front-end module 210. Fibre channel front-end (FE) 210 
provides the FC-0/1 level processing requirements. FE 
210 includes all of the character level state machines 
10 required to support a fibre channel link, including 
all of the requirements for normal data frame 
processing. FE 210 provides an interface to the system 
services processor for low level control over the 
fibre channel link interface. 

15 [0041] For the processing of frame traffic, FE 210 

provides independent, symmetrical RX and TX interfaces 
to carry frame data. These paths consist of a data bus 
and control signals that identify the beginning and 
ending frame delimiters. For the RX path, status 

20 information about the frame including CRC validation, 
truncated frames and other pertinent status is also 
included as part of the signal . 

[0042] Fibre channel front-end 210 continuously 
monitors its receive link for the detection of a start 

25 of frame (SOF) delimiter in the fibre channel frame. 

When a SOF is detected, FE 210 then forwards the frame 
to the RX module 220. RX module 220 stores the frame 
into the next available shared memory buffer. RX 
module 220 uses LR 200 to make a destination port 

30 routing decision from the header information of the 
received frame. RX module 220 then combines the 
shared memory buffer number into a field, which may be 
referred to as a Qentry field, which is passed to a TX 
module of the destination port through QC Module 205. 

\\\B0 - 83629/40 - #23720 v2 



RX module 22 0 then waits for the TX module to return 
the buffer number via an AckQEntry field. When RX 
module 220 receives the AckQEntry field it indicates 
to FE 210 that the buffer is being consumed. 

[0043] The time that is required for all this 
processing is less than 1 microsecond, for example, in 
a particular fibre channel implementation. For this 
example it is most likely that RX module 220 is still 
storing the received frame while the TX module is 
transmitting the same frame, creating a cut-through 
switching effect. If the TX did not immediately 
transmit the frame, it is possible that the entire 
frame has been written into the buffer memory when 
transmission commenced, providing for a store and 
forward type of switching function. 

[0044] The TX logic continuously monitors the bus 
coupling QC Controller 205 with TX module 230 for 
QEntries. When a QEntry is received, it is placed in 
TX module 230. When FE 210 is able to transmit a new 
frame, the queue selects a QEntry for processing. The 
shared memory buffer number for the frame to transmit 
is extracted from the QEntry and the TX module 
initiates a shared memory read operation. The frame 
data is then passed from the shared memory 12 0 to the 
FE 210. FE 210 transmits the frame. 

[0045] Continuing with Figure 2A, RX module 220 of 
port 130 is coupled to LR module 200 so as to request 
and receive exit port information. In one possible 
example, RX module 22 0 requests the identity of an 
exit port for a particular frame by sending a request 
over ReqExitPort connection 240 to LR 200. LR module 
200 performs the necessary procedure for retrieving 
the exit port identity based on the transmitted D_ID. 
LR module 2 00 then transmits the generated exit port 
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information to RX module 220 over ExitPort connection 
250 . 

[0046] Figures 3 and 4 illustrate the operation of 
local route control module 200 in greater detail. 
5 Local route control module 2 00 is used by GL_Port RX 
module 22 0 to request an exit port for a fibre channel 
frame based on the frame's D_ID value. In the 
illustrated example, the request for an exit port 
comes in on the ReqExitPort bus 240 to local route 
10 control 200. 

[0047] RX module requests an exit port by providing 
a D_ID from the frame header to local route control 
module 200 (step 400) . In one embodiment, the D_ID has 
24 bits, starting with the 0 bit, which is represented 

15 by a designation [23:0]. The first operation 320 of 
local route control module 200 is to determine if the 
D_ID identifies a multicast (MC) , a broadcast (BC) or 
a well-known address (WKA) (step 410) . Multicast and 
broadcast addresses are directed to a MC/BC/WKA table 

20 310 to identify the exit port. Weil-Known Addresses 
and FC-AL Loop Initialization addresses always result 
in the Embedded Port being selected as the Exit Port. 
Domain controller identifier addresses are sent to the 
central route table for exit port lookup unless a bit 

25 is set and the frame is not a class F frame, in which 
case the Embedded port is selected as the exit port. 

[0048] If central route table 110 has not yet been 
initialized, then all frames are routed to the 
embedded port. All other D__ID values are forwarded to 
30 central route table 110. However, prior to forwarding 
a request for an exit port to central route table 110, 
LR 200 performs an operation 330 to determine whether 
an association between the requested D_ID and an exit 
port designation is found in route cache 300 (step 



430) . If the D_ID to exit port association is found 
in route cache 300, the exit port is available 
immediately. Route cache 3 00 improves latency by 
caching the most recent exit port lookups. In one 
embodiment, the sixteen most recent lookups are stored 
in cache 300. Cache 300 should be cleared when either 
the central route table 110 or indirect exit tort 
table 350 is modified. 

[0049] If the D_ID is not located in route cache 
300, then local route controller 200 performs an 
operation 340 to send the D_ID to a central route 
table 110. Central route table 110 retrieves the D_ID 
to exit port association and returns it to local route 
controller 200. If applicable, the D_ID to exit port 
association is stored in an indirect exit port table 
350 (step 470). As shown in step 480, D_ID to exit 
port association is stored in route cache 300. In the 
illustrated example, D_ID to exit port association is 
sent to RX module over ExitPort bus 250 (step 490) . 

[0050] Shared memory 120 provides buffering and 
switching for all frames that flow through the switch 
100. Received frames are written to shared memory 120 
by the receiving port then read from shared memory 12 0 
by the transmitting port. In one embodiment, shared 
memory 120 has 136 total buffers shared by the 16 
GL_ports and the Embedded Port. For this example, each 
port may be allocated as many as 12 buffers, so long 
as the total of 136 buffers is not exceeded. 

[0051] Shared memory 120 is basically a data frame 
buffer that is spread out over several columns of 
memory. As shown in Figure 5A, in one embodiment, 
shared memory 12 0 is implemented as N SRAM modules. 
Each SRAM module comprises a column 300, where N is 
greater than or equal to the number of ports that 
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share the memory. In a preferred embodiment, N is 
odd. At each cycle, each port has access to one of 
the rows 310 in one of the columns 300. At the 
subsequent cycle, each port has access to the next row 
5 310 in a subsequent column 300. This allows each port 
to have access to each column 300 every N cycles. 

[0052] Figure 5B illustrates the example where 
N=17. In this example, shared memory must support 17 
ports at 2 x 2.125 8 bytes/second or 34 x 1 byte 
10 accesses/T 2 i2 • 34 x 1 byte accesses/T 2 i 2 is equivalent 
to 17 x 4 byte accesses/ Ti 0S . As such, a 2148 byte 
frame will consume 32 rows according to the following 
calculation : 

# of rows = 2148 bytes/ (17 columns*4 words/byte) 

15 [0053] Since the number of rows a frame consumes is 
essentially the size of the buffer, the more general 
equation to determine the number of rows per buffer is 
as f ol lows : 

20 # of rows/buffer = # bytes/buffer #bytes/row 

The number of bytes per row is determined by 
multiplying the number of columns by the number of 
bytes per word. 

25 [0054] Figure 5B illustrates how ports are assigned 
access to Columns. In the figure, Wn refers to a write 
cycle assigned to Port n, and Rn refers to a read 
cycle assigned to Port n. For the embedded port, n = 
16. Continuing, Figure 5B specifically illustrates 17 

30 columns and the read or write operation for each time 
modulo 34. In the illustrated example, at time modulo 
0, the ports are able to perform a write operation to 
a column of memory. As shown, port_0 performs a write 

\\\B0 - 83629/40 - #23720 v2 
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operation to the first column of memory, column 0. At 
time modulo 1, the ports can perform a read operation 
from a column of memory. As shown, port_0 performs a 
read operation from the first column of memory, column 
5 0. It should be understood that although the example 
shows port_0 writing and reading from column 0 at time 
modulo 0, any column could have been used as a 
starting point without departing from the intended 
scope of the invention. 

10 [0055] The first word of the frame should be 

written to the first available column. For example, if 
GL Port_7 has completed read and write cycles to 
Column 15, it will then get access to Column 16. After 
accessing Column 16, the port will next have access to 

15 Column 0, then Column 1, etc. 

[0056] Continuing with the example for port_0 , in 
the given example for N=17, the next 16 words will be 
written into the same row but the next column. Figure 
5B illustrates such an operation. At time modulo 2, 

20 port_0 performs a write operation in column 1, but in 
the same row as the write operation performed at time 
modulo 0. In this way, no columns in the first row 
are unused and no additional memory is necessary for 
each frame. Continuing with the example, at time 

25 modulo 3, port_0 performs a read operation from column 
1. The remainder of the example illustrated in Figure 
5B tracks the operation of performing a write to a 
column of memory, performing a read operation on the 
same column and then moving to the next column. 

30 [0057] As stated previously, to support 17 

simultaneous 4 -byte accesses every 106 MHz clock 
period, shared memory 120 is constructed from 17 
separate SRAM modules or columns. Each buffer is 
striped across all 17 columns and requires 32 rows per 
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buffer, where a row consists of 1 word at the same 
offset in each of the 17 columns. Continuing with the 
example of N=17, the total memory requirement for 136 
frame buffers is: 

5 

8 f rames/port*17 ports*32 rows/frame = 4352 rows 

However, memory depth is typically provided in 
multiples of 512 so there are actually 4608 rows. 

10 [0058] In one embodiment, shared memory 120 

supports both 1 Gbps and 2 Gbps read and write data 
rates. In one important aspect of the invention, 
shared memory 120 allows data to be written to a 
buffer at one rate and read from the same buffer at 

15 another rate, in this case 1 Gbps and 2 Gbps. One 

skilled in the art should understand that other data 
rates may be used without departing from the intended 
scope of the invention. 

[0059] Figure 6 illustrates the example of a 2 Gbps 
20 write and a 2 Gbps read operation after a 2 Gbps write 
operation. In this example, the read and write data 
rates are identical. The write operation will be 
explained first. As shown, at time 0 (0T) , the start 
of frame (SOF) word is written to column 7, row 0. 
25 The SOF delineates the beginning of the data from the 
frame. At time 2T (as will be explained hereinafter, 
a read operation is performed at time IT) , the first 
word A of the frame is written into column 8, also in 
row 0. At each successive write time, in this case 
30 each time nT where n is an even number, the next word 
is written into the subsequent column, but in the same 
row . 

[0060] Continuing with the write example of Figure 
6, at time 34T, no additional space is available in 
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row 0, column 7 for another word since the SOF was 
written in this location at time 0T. Therefore, the 
shared memory moves down a row and writes the next 
word Q in row 1, column 7. As illustrated, the write 
5 operation continues in row 1 at each subsequent column 
until the end of frame (EOF) delineator is received. 

[0061] Continuing with the example illustrated in 
Figure 6, a 2 Gbps read operation after a 2 Gbps write 
operation is shown. Figure 6 also shows the two FIFO 

10 registers, FIFO_0 and FIF0_1, for storing words during 
a read operation. Since the data rates are identical 
for the read and write operation, the data will move 
alternately into FIFO_0 and FIFO_l and then move 
alternately out of FIFO_0 and FIFO_l . According to 

15 the example, at time IT, the SOF delineator is read 

from column 7, row 0 into FIFO_0 . At time 3T, word A 
is read from column 8, row 0 into FIFO_l . Continuing, 
at time 5T, word B is read from column 9, row 0 into 
FIFO_0 . This "ping-pong" operation continues until 

20 the EOF delineator is read into FIFO_0. Meanwhile, 

since a read from a FIFO is done concurrently with a 
write to a FIFO, data is read alternately from FIFO_0 
and FIFO_l to the receiving port at a 2 Gbps rate. 

[0062] Figure 7 illustrates the example of a 2 Gbps 
25 write and a 1 Gbps read operation after a 2 Gbps write 
operation. In this example, the read and write data 
rates are different. The write operation will be 
explained first. As shown, at time 0 (0T) , the start 
of frame (SOF) word is written to column 7, row 0. As 
30 explained previously, the SOF delineates the beginning 
of the data from the frame. At time 2T, the first 
word A of the frame is written into column 8, also in 
row 0. At each successive write time, in this case 
each even time nT where n is an even number, the next 
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word is written into the subsequent column, but in the 
same row. 

[0063] Continuing with the write example of Figure 
7, at time 34T, no additional space is available in 
5 row 0, column 7 for an another word since the SOF was 
written in this location at time OT. Therefore, the 
shared memory moves down a row and writes the next 
word Q into row 1, column 7. As illustrated, the 
write operation continues in row 1 at each subsequent 
10 column until the end of frame (EOF) delineator is 
received . 

[0064] Continuing with the example illustrated in 
Figure 7, a 1 Gbps read operation after a 2 Gbps write 
operation is shown. Figure 7 also shows the two FIFO 

15 registers, FIFO_0 and FIFO_l, for storing words during 
a read operation. Since the data rates are not 
identical for the read and write operation in Figure 
7, the data will move alternately into FIFO_0 and 
FIF0_1, pausing for 17 cycles after every 17 cycles to 

20 match rates. Meanwhile, the data is moved alternately 
out of FIFO_0 and FIFO_l at a 1 Gbps rate. 

[0065] According to the example of figure 7, at 
time IT, the SOF delineator is read from column 7, row 
0 into FIFO_0 . At time 3T, word A is read from column 

25 8, row 0 into FIFO_l . Continuing, at time 5T, word B 
is read from column 9, row 0 into FIFO_0 . This "ping- 
pong" operation continues until word P is read into 
FIFO_0. At this point, the operation pauses from 35T 
to 67T for purposes of matching the rates. The read 

30 operation then continues at 69T thereby reading word Q 
into FIFO_l. This "ping-pong" operation continues 
until the EOF delineator is read into FIFO_0. Data is 
read alternately from FIFO_0 and FIFO_l to the 
receiving port at a 1 Gbps rate. 
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[0066] Figure 8 illustrates the example of a 1 Gbps 
write and a 2 Gbps read operation after a 1 Gbps write 
operation. In this example, the read and write data 
rates are different. The 1 Gbps write operation will 
5 be explained first. As shown, at time 0 (0T), the 

start of frame (SOF) word is written to column 7, row 
0. As explained previously, the SOF delineates the 
beginning of the data from the frame. At time 2T, the 
first word A of the frame is written into column 9, 

10 also in row 0. For the time being, row 0, column 8 is 
skipped. At each successive write time, in this case 
each even time nT where n is an even number, the next 
word is written into the second subsequent column, but 
in the same row. As shown in the example, at time 

15 28T, word I is written into the previously skipped 
column 8 , row 0 . 

[0067] Continuing with the write example of Figure 

8, at time 68T, no additional space is available in 
row 0, column 7 for an another word since the SOF was 

20 written in this location at time 0T. Therefore, the 
shared memory moves down a row and writes the next 
word Q into row 1, column 7. As illustrated, the 
write operation continues in row 1 at every other 
subsequent column until the end of frame (EOF) 

25 delineator is received. 

[0068] Continuing with the example illustrated in 
Figure 8, a 2 Gbps read operation after a 1 Gbps write 
operation is shown. Figure 8 shows the two FIFO 
registers, FIFO_0 and FIFO_l, for storing words during 

30 a read operation. Since the data rates are not 

identical for the read and write operation in Figure 
8, the data will move alternately into FIFO_0 and 
FIFO_l, and then move alternately out of FIFO_0 and 
FIFO_l in a manner such that the words are read out in 

35 a proper order. 
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[0069] According to the example of figure 8, at 
time IT, the SOF delineator is read from column 7, row 
0 into FIFO_0 . At time 3T, word A is read from column 
8, row 0 into FIFO_l. Continuing, at time 5T, word B 
5 is read from column 9, row 0 into FIFO_0 . This "ping- 
pong" operation continues until word T is read into 
FIFO_l . At this point, there is no word to read into 
FIFO_0 . The read operation skips FIFO_0 but the read 
operation then continues at 51T thereby reading word U 
10 into FIF0_1. This "ping-pong" operation continues 
until the EOF delineator is read into FIFO_0 . 

[0070] Data is read alternately from FIFO_0 and 
FIFO_l to the receiving port in a manner so as to 
ensure the order and therefore integrity of the frame. 

15 In the illustrated example, the first nine words are 

read out of FIFO_0. The number of words is determined 
by the equation (N+l)/2 where N is equal to the number 
of ports. Once the first nine words are read from 
FIFO_0, the first seventeen words are read from 

20 FIFO_l. The number of words read from FIFO_l is equal 
to the number of ports N. Then, the remaining words 
are read from FIFO_0, however, if there were more than 
N words only the first N words would be written from 
FIFO_0. The sequence (N+D/2, N i# N 2 . . . N x 

25 represents this procedure of reading words from FIFO_0 
and FIFO_l, wherein N represents the number of ports 
and x represents the number of read operations to 
completely empty FIFO_0 and FIFO_l . 

[0071] Figure 9 illustrates the example of a 1 Gbps 
30 write and a 1 Gbps read operation after a 1 Gbps write 
operation. In this example, the read and write data 
rates are identical. The 1 Gbps write operation will 
be explained first. As shown, at time 0 (0T), the 
start of frame (SOF) word is written to column 7, row 
35 0. At time 2T, the first word A of the frame is 
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written into column 9, also in row 0. In the interim, 
row 0, column 8 is skipped. At each successive write 
time, in this case each even time nT where n is an 
even number, the next word is written into the second 
5 subsequent column, but in the same row. As shown in 
the example, at time 28T, word I is written into the 
previously skipped column 8, row 0. 

[0072] Continuing with the write example of Figure 

9, at time 68T, no additional space is available in 
10 row 0, column 7 for an another word since the SOF 

delineator was written in this location at time 0T. 

Therefore, the shared memory moves down a row and 
Hi writes the next word Q into row 1, column 7. As 

ill illustrated, the write operation continues in row 1 at 

K 15 the second subsequent column until the end of frame 

=11 (EOF) delineator is received. 

Til 

I" [0073] Continuing with the example illustrated in 

O Figure 9, a 1 Gbps read operation after a 1 Gbps write 

l^i operation is shown. Figure 8 shows the two FIFO 

'"4 20 registers, FIFO_0 and FIFO_l, for storing words during 

Q 

l. ih a read operation. Since the data rates are identical 

for the read and write operation in Figure 9, the data 
will be written into FIFO_0, thereby skipping FIF0_1, 
and then move out of FIFO_0 at a 1 Gbps rate. 

25 [0074] According to the example of figure 9, at 

time IT, the SOF delineator is read from column 7, row 
0 into FIFO_0. At time 3T, word A is read from column 
9, row 0 into FIFO_0 . Continuing, at time 5T, word B 
is read from column 11, row 0 into FIFO_0 . Nothing is 

30 written into FIFO_l. This operation continues until 

the EOF delineator is read into FIFO_0 . The words are 
then read out of FIFO_0 at a 1 Gbps rate to the 
receiving port. 
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[0075] Figure 10 illustrates the structure of a 
request exit port bus ring structure . The request 
exit port bus is used by the receive controller of a 
GL_Port to request an exit port number for a given 
5 D__ID from the central route controller. The request 
exit port bus is designed to operate in a ring 
structure in which each module that is attached to the 
request exit port bus pipelines and re-powers the 
request exit port bus signals before sending them to 
10 the next module in the ring. The local route control 
module is used to provide the attachment to the 
request exit port bus for each module. The request 
exit port bus signals are described in Table 1. 



Signal 


Bits 


Description 


xx_y y_r e q ep_v 


1 


Valid bit. Set to '1' for 1 period 
when xx_yy_reqep_* signals are 
valid. A module may insert its 
request for an exit port on the bus 
when it detects that this bit is 
'0', indicating an empty time slot. 


xx_yy_reqep_rxport 


5 


Receive Port Number. Indicates 
which receiver port is requesting an 
exit port . 


xx yy reqep d id 
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Frame destination ID field (D ID) . 


xx_yy_reqep_bid 


2 


Buffer Identifier. Used to 
guarantee in-order delivery of exit 
port information. 


xx_yy_reqep_p 


1 


Odd Parity. A parity error is 
reported as a rare event and the 
request is disgarded. 



Table 1 - Request Exit Port Bus Signal Descriptors 
15 [0076] Figure 10 also illustrates the exit port 

response bus ring. The exit port response bus is used 
by the central route controller to return an exit port 
number to an RX module of a GL_Port . The exit port 
response bus is designed to operate in a ring 
20 structure in which each module that is attached to the 
exit port response bus pipelines and re-powers the 
exit port response bus signals before sending them to 
the next module in the ring. 



[0077] The central route controller may insert an 
exit port response on the bus in any clock cycle. A 
local route control module will extract the exit port 
response from the bus if it is addressed to that 
GL_Port . The local route control module is used to 
provide the attachment to the exit port response bus 
for each module. The exit port response bus signals 
are described in Table 2 . 



Signal 


Bits 


Description 


xx_yy_ep_v 


1 


Valid bit. Set to '1' for 1 period 
when all xx_yy_ep_* signals are 
valid. Always set to '!' by the 
central route control module. 
Cleared to '0' by the GL Port, 
addressed by xx_yy_ep_rxport , that 
receives the exit port information. 


xx_yy_ep_err 


2 


Error Status. 00 :OK, 01: Parity Err, 
10:Bad D ID, 11: Zone Blocked. 


xx_yy_ep_rxport 


5 


Receive Port Number. Indicates 
which receive port that the exit 
port information is destined for. 


xx_yy_ep_indirect 


1 


Indirect Lookup Required Bit. When 
set to ' 1 ' the Indirect Lookup 
Table, addressed by 

xx_yy_ep_txport [3 : 0 ] , must be used 
for determining the exit port. 


xx_yy_ep_txport 


5 


Transmit Port. Identifies the exit 
port to which a frame must be sent. 
xx_yy_ep_txport [3 : 0] addressed the 
Indirect Lookup Table when the 
indirect bit is set to '1'. 


xx_yy_ep_bid 


2 


Buffer Identifier. Used to 
guarantee in-order delivery of exit 
port information. 


xx_yy_ep_p 


1 


Odd Parity. A parity error is 
reported as a rare event and the 
exit port information is disgarded. 



Table 2 - Exit Port Response Bus Signal Descriptors 
[0078] While there have been described above the 
principles of the present invention in conjunction 
with a specific embodiment, it is to be clearly 
understood that the foregoing description is made only 
by way of example and not as a limitation to the scope 
of the invention. Particularly, it is recognized that 
the teachings of the foregoing disclosure will suggest 
other modifications to those persons skilled in the 
relevant art. Such modifications may involve other 
features which are already known per se and which may 
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be used instead of or in addition to features already 
described herein. 

[0079] Although claims have been formulated in this 
application to particular combinations of features, it 
5 should be understood that the scope of the disclosure 
herein also includes any novel feature or any novel 
combination of features disclosed either explicitly or 
implicitly or any generalization or modification 
thereof which would be apparent to persons skilled in 

10 the relevant art, whether or not such relates to the 
same invention as presently claimed in any claim and 
whether or not it mitigates any or all of the same 
technical problems as confronted by the present 
invention. The applicants hereby reserve the right to 

15 formulate new claims to such features and/or 

combinations of such features during the prosecution 
of the present application or of any further 
application derived therefrom. 



What is claimed is: 



